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Abstract 

Cfzek, Zamastil, and Skala [J. Math. Phys. 44, 962 - 968 (2003)] introduced in con- 
nection with the summation of the divergent perturbation expansion of the hydrogen 
atom in an external magnetic field a new sequence transformation which uses as input 
data not only the elements of a sequence {s n }^L of partial sums, but also explicit esti- 
mates {u! n }^L for the truncation errors. The explicit incorporation of the information 
contained in the truncation error estimates makes this and related transformations 
potentially much more powerful than for instance Pade approximants. Special cases 
of the new transformation are sequence transformations introduced by Levin [Int. J. 
Comput. Math. B 3, 371 - 388 (1973)] and Weniger [Comput. Phys. Rep. 10, 189 
- 371 (1989), Sections 7 -9; Numer. Algor. 3, 477 - 486 (1992)] and also a variant of 
Richardson extrapolation [Phil. Trans. Roy. Soc. London A 226, 299 - 349 (1927)]. The 
algebraic theory of these transformations - explicit expressions, recurrence formulas, 
explicit expressions in the case of special remainder estimates, and asymptotic order 
estimates satisfied by rational approximants to power series - is formulated in terms 
of hitherto unknown mathematical properties of the new transformation introduced 
by Cfzek, Zamastil, and Skala. This leads to a considerable formal simplification and 
unification. 



CONTENTS 



Contents 

ll Introduction! 1 

|2 Explicit Expressions via Annihilation Operator d 3 

|3 Recurrence Formulas! 9 

14 Levin's Explicit Remainder Estimated 11 

|5 Richardson- Type Transformations! 19 

|6 Rational Approximantd 23 

17 Summary and Outlookl 30 



Ernst Joachim Weniger: A New Levin- Type Sequence Transformation. I. 



1: Introduction 



1 



1 Introduction 

The most important and most versatile systematic approximation method in quantum 
physics is eigenvalue perturbation theory (see for example 125 ). Thus, the question, 
whether perturbation expansions converge or diverge, is of principal importance. Already 
in 1952, Dyson |54| had argued that perturbation expansions in quantum electrodynamics 
should diverge. Around 1970, Bender and Wu |10I11I12| showed in their work on anharmonic 
oscillators that factorially divergent perturbation expansions occur also in nonrelativistic 
quantum mechanics. In the following years, many other quantum systems were investi- 
gated, and in the overwhelming majority factorially divergent perturbation expansions were 
found (see for example [H2I Table 1] or the articles reprinted in [SHI)- Consequently, summa- 
tion methods are needed to give the divergent perturbation series of quantum physics any 
meaning beyond mere formal expansions and to extract numerical information from them. 
A very readable discussion of the usefulness of summation and related techniques from a 
physicist's point of view can be found in the monograph by Bender and Orszag [Hj- 

Factorially divergent power scries occur also in asymptotic expansions for special func- 
tions. However, special functions can normally be computed via a variety of different repre- 
sentations. Accordingly, in mathematics there is usually no compelling need to use divergent 
series for computational purposes, whereas in quantum physics it is frequently quite difficult 
or even impossible to find alternatives to divergent perturbation expansions. Consequently, 
summation techniques are far more important in physics than in mathematics. Neverthe- 
less, the evaluation of special functions by summing divergent asymptotic expansions can 
be remarkably effective (see for example |133lll3filll4()lll47| L 

In physics, the best known and most widely used summation techniques are Borel sum- 
mation 15, 16 , which replaces a divergent perturbation expansion by a Laplace-type inte- 
gral, and the method of Pade approximants which transforms the partial sums of a 
power series to a rational function. Both approaches have been remarkably successful, but 
they have - like all other numerical techniques - certain shortcomings and limitations. For 
example, the Borel method is very powerful, but conceptually and computationally very 
demanding. From a technical point of view, Pade approximants can be applied remark- 
ably easily, but they are not necessarily powerful enough to sum all perturbation series of 
interest. For example, Graffi and Grecchi [^1 showed rigorously that Pade approximants 
are not able to sum the perturbation expansion of the octic anharmonic oscillator whose 
series coefficients grow roughly like (Sn)!/™ 1 / 2 ^2 Eq. (3)]- Accordingly, it is worth while to 
look for alternative techniques which arc at least in some cases capable of producing better 
summation results. 

Pade approximants accomplish an acceleration of convergence or a summation by con- 
verting the partial sums of a power series to a doubly indexed sequence of rational functions. 
This is also done by other, albeit less well known nonlinear transformations (see for exam- 
ple |19ll2(Jll3*Tlll52l lT32 ). It is not so well known among non-specialists that some of these 
transformations sum many strongly divergent power series much more effectively than Pade 
approximants can do it. Particularly suited for the summation of strongly divergent series 
is a class of sequence transformations introduced by Levin |9()j in 1973. These transforma- 
tions use as input data not only the elements of a slowly convergent or divergent sequence 
{ s n}™ = 0' whose elements may for instance be the partial sums s n — Y^k=o ak °^ an i nnm tc 
series, but also explicit remainder estimates {w n }™ =0 . Several generalizations and extensions 
of Levin's transformation were derived later, for instance in |132l Sections 7 - 9] or in |134| . 
Further details as well as the description of several other Levin-type transformations can be 
found in a recent review by Homeier |74j . 

The explicit incorporation of the information contained in the remainder estimates 
{ w n}5^o makes all Levin- type transformation potentially very powerful (see for exam- 
ple the numerical examples in |126H127lll32| L In the case of divergent alternating se- 
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ries, the so-called delta transformation [1321 Eq. (8.4-4)] was found to be particularly use- 
ful pTll^ll^71l^51f7TII5^irT5^i n ^311 i ^4111 3 i 3711 i c^^ll i ^1>II 1 4 HfT^ll i 4411 i 4811 i 4<j| . 

However, sequence transformations in general or the Levin-type transformations men- 
tioned above in special are not only useful for the summation of divergent perturbation 
expansions. In recent years, many other successful applications of Levin-type transforma- 
tions have been reported in the literature (see for example |2I4I5I6I14I1HI18I^7I4(SI47I52I53I 



Ii()8llirtliftiidi20li28li3(ii:^ This 



list does not claim to be complete, but it suffices to show that Levin-type transformations 
are extremely useful computational tools which deserve to be more widely known. 

In connection with the summation of the perturbation series for a hydrogen atom in an 
external magnetic field, Cizek, Zamastil, and Skala introduced a new sequence transforma- 
tion [18, Eq. (10)], which in the notation of |132| can be expressed as follows: 



Here as well as later in the text it is always assumed that 111?=; a k = 1 holds if it is a 
so-called empty product with I > n. 

The sequence transformation contains the unspecified parameters q m with 1 < m < 
k — 1. As discussed in Section|21in more details, several other sequence transformations can 
be obtained by specifying the parameters q m . If we for instance choose q m = /3 with (3 > 0, 
we obtain Levin's transformation £^™- > (/3, s„, io n ) J§U| in the notation of |132l 7.1-7]), if we 

choose q m = /3 + m — 1, we obtain (/3, s n ,uj n ) [1321 Eq. (8.2-7)], which is the parent 
transformation of the so-called delta transformation [1321 Eq. (8.4-4)] mentioned above, and 
if we choose q m = £ - m+ 1 with f > 0, we obtain Mj^(£, s n ,u n ) Q32 Eq. (9.2-6)]. Then, 
there is a sequence transformation G^\a,f3, s n , uj n ) [1341 Eq. (3.2)] which - depending on 
the value of the parameter a - interpolates between Levin's transformation £i (/3, s n ,oj n ) 
and (/3, s n ,uj n ). It is obtained by choosing q m ~ (3 + [to — l]/a. 

Thus, the transformation S^isinn s n ,uj n ) introduced by Cizek, Zamastil, and Skala 
provides a unifying concept for a large and practically important class of sequence transfor- 
mations, and all results derived for S^ilmi s n ,Lu n ) can immediately be translated to the 
analogous results for its various special cases. However, so far only the explicit expression 
for this transformation as the ratio of two finite sums according to (|1.1|) is known |481 Eq. 
(10)], and many other mathematical properties of interest are unknown. 

In Section [3 the explicit expression for S^ilm, s n , u> n ) is rederived by applying a suit- 
able annihilating difference operator to the model sequence (|2.12(l according to (|2.9|l . This 
annihilation operator approach was originally introduced in |132l Section 3.2] in connec- 
tion with a simplified derivation of the explicit expression for Levin's transformation |90| 
and the construction of explicit expressions for other, closely related sequence transforma- 
tions |132l Sections 7-9]. This annihilation operator approach does not only produce the 
explicit expression (|l.lll . but it also provides a convenient starting point for the derivation 
of a recursive scheme for the numerators and denominators in ll.lj l. which is done in Section 
and for a theoretical convergence analysis, which will be done in |14fi| . 

In Section simple explicit remainder estimates introduced by Levin I90j and Smith 
and Ford |126| . which in the terminology of |132j yield the u, t, v, and d variants of Levin's 
sequence transformation, are used in combination with 9& (9m, s n , u> n ). The effectivity of 



Sfc (q m ,s n ,oj n ) 




k,n€N . 



(1.1) 




k 



k-1 



Ernst Joachim Weniger: A New Levin- Type Sequence Transformation. I. 



2: Explicit Expressions via Annihilation Operators 



3 



these remainder estimates is motivated and studied via some model sequences. Surprisingly, 
the v type remainder estimate produces more effective asymptotic estimates for the trunca- 
tion errors of these model sequences than the other simple remainder estimates. Moreover, 
it is shown that all t type variants considered in this article are actually analogous d type 
variants in disguise. 

In Sectional variants of (<Zm, s n, w n ) are studied which closely resemble the Richard- 
son extrapolation process |l()4j . These variants be used in the case of logarithmic conver- 
gence (p = 1 in JIUJl), whose acceleration constitutes a formidable computational problem. 

In Section H3 the u, t, d, and v variants of si (<7m, s n , uj n ) are applied to the partial 
sums of a (formal) power series. This produces rational approximants that resemble Pade 
approximants, which are defined via the accuracy-through-order relationship (|6.3|1 . In the 
case of the u, t, and d variants, the resulting rational expressions are actually Pade-type 
approximants, which satisfy the modified accuracy-through-order relationship 16.15fl 22 . 
In the case of the v variant the resulting expression is a slight generalization of a Pade- 
type approximant. With the help of the accuracy-through-order relationship H6.15J) . which 
defines Pade-type approximants, the accuracy-through-order relationships satisfied by these 
rational functions can be derived easily. These accuracy-through-order relationships are 
needed if the rational approximants derived from 5 < ^\q m , s n ,Lu n ) are to be used for the 
prediction of unknown power series coefficients. 

This article is concluded in Section [7| by a short summary and a critical assessment of 
the essential features of the new Levin-type transformation introduced by recently Cizek, 
Zamastil, and Skala |48j . 

Only the mathematical properties of Sfc™' ) (9m, s„, w„) and its various special cases are 
treated in this article, albeit in a relatively detailed way. Anybody interested in other 
sequence transformations should consult the monograph by Brezinski and Redivo Zaglia |31j . 
It contains a wealth of material and provides a very readable introduction to a rapidly 
growing subfield of numerical mathematics. The older history of sequence transformations 
up to about 1945 is treated in a monograph by Brezinski |24|. and the more recent history 
is discussed in two articles, also by Brezinski |25II29 |. 

Finally, one should not forget that the study of sequence transformations remains in- 
complete without the simultaneous study of Pade approximants. Here, I recommend the 
book by Baker and Graves-Morris |3J- 

2 Explicit Expressions via Annihilation Operators 

Let us assume that {s„}^L is a slowly convergent or divergent sequence, whose elements 
may for instance be the partial sums s n = J2k=o a k °f an infinite series. A sequence transfor- 
mation is a rule which maps a sequence {s n }^ to a new sequence {s^j^Lo with hopefully 
better numerical properties. 

The basic step for the construction of a sequence transformation is the assumption 
that the elements of a convergent or divergent sequence {s n }^L can De partitioned into a 
(generalized) limit s and a remainder r n according to 

s n = s + r n , ii£N . (2.1) 

A sequence transformation tries to accomplish an acceleration of convergence or a sum- 
mation by eliminating the remainders r n as effectively as possible from the input data s n 
with the help of numerical techniques. In realistic problems, a sequence transformation can 
only eliminate approximations to the remainders. Consequently, the transformed sequence 
{KAn^o wm a ^ so be of the type of (|2.1|) . which means that s' n can also be partitioned into 
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the (generalized) limit s and a transformed remainder r' n according to 

s' n = s + r' n , Tie N . (2.2) 

The transformed remainders {r' n }^L a are m general different from zero for all finite values of 
n. However, convergence is accelerated if the transformed remainders {r' n }^—Q vanish more 
rapidly than the original remainders {r n }^Lo according to 

li m ?k—L = i im !« = o, (2.3) 

n^oo s n — s n^oa r n 

and a divergent sequence is summed if the transformed remainders r' n vanish as n — > oo. 

In practice, an in principle unlimited variety of different types of remainders can occur. 
Therefore, it is essential to make some assumptions - either explicitly or implicitly - which 
provide the basis for the construction of a sequence transformation. 

Let us assume that we have sufficient reason to believe that the elements of a sequence 
{s n }^ =0 can for all n £ No be expressed by an expansion of the following type: 

oo 

s " = s + c 3 , >pj( n )- ( 2 - 4 ) 

3=0 

The tpj (n) are assumed to be known functions of n, but otherwise essentially arbitrary, and 
the Cj are unspecified coefficients independent of n. Hence, the ansatz (|2.4f) incorporates 
convergent as well as divergent sequences, depending upon the behavior of the functions 
4>j(n) as n — > oo. 

If we want to accelerate the convergence of {s n } c ^' = o to its limit s or to sum it in the case of 
divergence with the help of a sequence transformation, we have to compute approximations 
to the remainders X)j!Lo c j' l i ) 3^ n ) ana - to eliminate them from the input data. However, the 
remainders of the sequence (|2.4f) contain an infinite number of unspecified coefficients Cj. 
Consequently, a complete determination of the remainders and their subsequent elimination 
cannot be accomplished by purely numerical means. 

Let us also assume that the functions {tpj (n)}°°^ form an asymptotic sequence as n — > oo, 
i.e, that they satisfy for all j E No 

ipj+i(n) = o(V>j(n)) , n-*oo. (2.5) 

The best, which a purely numerical process can accomplish, is the elimination of a finite 
number of the leading terms of 1)2.4(1 . Obviously, this corresponds to the transformation of 
the sequence l|2.4|l to a new sequence {s^}^L whose elements satisfy 

oo 

s 'n = s + C '^k+M > neN , keN. (2.6) 

3=0 

The c'j are numerical coefficients that depend on k as well as on the coefficients Cj in 1)2.4(1 . 

Obviously, the original remainders YI^-q Cjipj(n) are not completely eliminated from 
the elements of the input sequence l|2.4(l . Since, however, the functions {V'j( n )}^Lo are 
by assumption an asymptotic sequence according to (|2.5(l . the transformed remainders 
J^jLo c jV'fc+i( n ) m lESt should at least for sufficiently large values of k e N have sig- 
nificantly better numerical properties than the original remainders c j 1 /'i( n )- 

Assumptions about the rt-dependence of the truncation errors r n can be incorporated into 
the transformation process via model sequences. In this approach, a sequence transformation 
is constructed which produces the (generalized) limit s of the model sequence 

fc-i 

s n = s + r n = s + Cj ipj(n), keN, n E N , (2.7) 

3=0 
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if it is applied to k + 1 consecutive elements s„, s„+i, . . . , s n +/c of this model sequence. 
Since the ipj (n) are assumed to be known functions of n, an element of this model sequence 
contains k + 1 unknown, the (generalized) limit s and the A; unspecified coefficients cq, ci, 
. . . , Cfe_i. Accordingly, it follows from Cramer's rule that a sequence transformation, which 
is exact for the model sequence (I2.7II . can be expressed as the ratio of two determinants 
(see for example |31l Section 1.5]). However, determinantal representations will not be 
considered here since they are computationally unattractive. Fortunately, the sequence 
transformation, which is exact for the general model sequence <|2.7|l . can also be computed 
recursively, as shown independently by Schneider |119| . Havie |7()| and Brezinski |21| . An 
alternative recursive scheme, which is more economical than the original recursive scheme, 
was later obtained by Ford and Sidi |63| . 

A detailed discussion of the construction of sequence transformations via model sequences 
as well as many examples can for instance be found in the book by Brezinski and Redivo 
Zaglia |3T] or in (132] . 

Levin-type sequence transformations try to make the transformation process more ef- 
ficient by explicitly utilizing the information contained in remainder estimates {w n }^L . 
Thus, a sequence transformation is constructed which is exact for the elements of the model 
sequence [TJJ, Eq. (3.2-9)] 

s n = s + Lo n z n , n <E N . (2.8) 



The remainder estimates w„ are assumed to be known, and the correction terms z n should 
be chosen in such a way that the products uj n z n provide sufficiently accurate and rapidly 
convergent approximations to actual remainders. The principal advantage of this approach is 
that only the correction terms {zn}^o have to be determined. If good remainder estimates 
can be found, the determination of z n and the subsequent elimination of w„z„ from s n often 
leads to substantially better results than the construction and subsequent elimination of 
other approximations to r n . 

The model sequence l|2.8l) has another indisputable advantage: There exists a systematic 
approach for the construction of a sequence transformation which is exact for this model 
sequence. Let us assume that a linear operator T can be found which annihilates for all n S 
No the correction term z n according to T(z n ) = 0. Then, a sequence transformation, which 
is exact for the model sequence (I2.8|) . can be obtained by applying T to [s n — s]/uj n = z n . 
Since T annihilates z n and is by assumption linear, the following sequence transformation 
T is exact for the model sequence H2.8jl 132, Eq. (3.2-11)]: 

<ty i T(s n /uj n ) 

T(s„,w„) = — - = s. (2.9) 

T(l/uj n ) 

The construction of sequence transformations via annihilation operators was introduced 
in [1321 Section 3.2] in connection with a rederivation of Levin's transformation [i|U| and the 
construction of some other, closely related sequence transformations 132, Sections 7-9]. 

Later, this annihilation operator approach was discussed and extended in books by 
Brezinski [20] and Brezinski and Redivo Zaglia JI] and in articles by Brezinski [2512712 8 29 , 
Brezinski and Matos Brezinski and Redivo Zaglia 32,33 ,34 , Brezinski and Salam |35|. 
Homeier [731, Matos |H2], and Weniger [T53| . 

Simple and yet very powerful sequence transformations result [1321 Sections 7 - 9] if the 
annihilation operator T in l|2.9|l is based upon the finite difference operator A defined by 
A/(n) = f(n+ 1) — f(n). As is well known, the fc-th power of the finite difference operator 
annihilates a polynomial Pk-i(n) of degree k — 1 in n according to A k Pk-i(n) = 0. Thus, 
the correction terms z n in 12.8JI should be chosen in such a way that multiplication of z n by 
some suitable quantity Wk(n) yields a polynomial Pk-i(n) of degree k — 1 in n. If such a 
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Wk{n) can be found, then 

A k [w k (n)z n } = A k P k ^(n) = (2.10) 

and the weighted difference operator T = A k Wk(n) annihilates z n . Thus, the corresponding 
sequence transformation (|2.9|) is given by the ratio 

rr(")/ ( m \ A k [w k (n)s n /uj n } 

Tl, (w k (n) \s n ,uj n ) = —J- — — - — -. (2.11) 

The sequence transformation (|l.l|l introduced by Cizek, Zamastil, and Skala can be 
constructed on the basis of the model sequence Eq. (9)] 

fc-i 

s n = s + u> n y2— ■ ^ -, fceN, neN . (2.12) 

j=o n m =i(n + q m ) 

It will become clear later (compare ()4.5f) and the discussion related to it) that in (|2.12|) as 
well as in the model sequences (|2.16|) . (I2.19f) . <|2.23[) . and (|2.27|l . which can be derived from 
(|2.12() . it makes sense to assume cq ^ 0. 

Both in the model sequence Ij2.12|l as well as in the sequence transformation, which is 
derived from it, we want to admit n = 0. Moreover, this model sequence should have a 
consistent behavior for all n G No- Thus, we normally require q m > for < m < k — 1, 
but otherwise these parameters are essentially arbitrary. 

Multiplication of the sum in l|2.12|l by Y\^2i( n + Qm) yields X^=o c j Ui=j+i( n + 1m), 
which is a polynomial of degree k— 1 in n. Thus, T = A fc Y[ m =i( n ^~1 m ) ^ s ^ ne operator which 
annihilates the correction term in l|2.12|l , and we obtain from (|2.9|l the following difference 
operator representation for the sequence transformation introduced by Cizek, Zamastil, and 
Skala |m Eq. (10)]: 

fc-i 



A fc n 

m—1 

k-1 | 

A k Y[ {n + q m ) — 



9 k n \q m ,s n ,u> n ) = ^ , k,neN . (2.13) 



m— 1 

It will become clear later that this difference operator representation is in some sense more 
fundamental and more important than the explicit expression which can be derived easily 
from it. We only have to insert the well-known relationship 

'k 



A k f(n) = {-l) k ^ (-iy /(n + j) (2.14) 
into the numerator and denominator of (|2.13|) to obtain 

£(-l)'(T) li(n + 3+q m )^ 

(n) ^ m=l 

S k n) (q m ,Sn,u n ) = °-f — x , k 7 ne N . (2.15) 

E(-l) j f") E[(n + i + *,* 1 



j=0 



3 J , ^n+j 



In the case of large transformation orders k, terms that are large in magnitude occur in 
the binomial sums in the numerator and denominator of l|2.15|l . The same problem occurs 
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also in explicit expressions for other Levin-type sequence transformation discussed later. In 
the case of some FORTRAN compilers, this can easily lead to OVERFLOW. To decrease 
the magnitude of the terms, it has become customary to include an additional normalization 
factor. Thus, we divide numerator and denominator of H2.15[l by rim=i( n + ^ + Qm) and 
obtain . Such an approach is always possible since the coefficients of a ratio like (|2.15(l 
are only defined up to a common nonzero factor. 

If we choose in (I2.12[) q m — (3 with (3 > 0, we obtain the model sequence for Levin's 
transformation 90 in the notation of [1321 Eq. (7.1-2)]: 

fc-i 

s n = s + oj n V Cj , fceN, ne N . (2.16) 

Thus, the corresponding annihilation operator is given by f = A k (/3 + n) k - 1 and Levin's 
transformation [5U| can in the notation of |132l Eq. (7.1-7)] be expressed as follows: 



r (n)/„ \ G (n) m , A k [(p + n) k 1 s n /uj r , 



k 

£(-D j 

3=0 



k\ (/S + n + j)"- 1 s n+j 



jj (P + n + k) 1 *- 1 u. 



n+j 



k 

£(-D j 

3=0 



k\ (/3 + n + jf- 1 1 



(2.17) 



k,neN . (2.18) 



j J {/3 + n + k) k - x 



Jn+j 



If we choose in (I2.12f) q m = (3 + m — 1 with (3 > 0, we obtain the following model se- 
quence [1321 Eq. (8.2-1)] for the sequence transformation §^((3, s n ,Lu n ) which is a truncated 
factorial series involving Pochhammer symbols (j3 + n)j = T(f3 + n + j)/T({3 + n): 

fc-i 

s n = s + u n ln C _l x » keN, neN . (2.19) 
IP + n )j 



3=0 



The fundamental properties of factorial series are for instance discussed in books by Nielsen 
[Mj and Norlund 

The annihilation operator for the model sequence (|2.19|l is given by T = A k ((3 + n)k-i 
and the sequence transformation $^\l3, s n , u> n ), which is exact for the model sequence 
(|2~B|) . can be expressed as follows [H3 Eq. (8.2-7)]: 

§i V, W) = 9[ \(3 + m -l, Sn ,u n ) = Ak[{f3 + n)k _ i/uJn] (2-20) 



k 

£(-i) j 

3=0 



k\ ((3 + n + j) fc _i s n+j 



jj {J3 + n + k)k-i LJn+j 



k 

EM)'' 

3 = 



k\ ((3 + n + j) k -i 1 



fc,neN . (2.21) 



j J ((3 + n + k)k-i u n +j 



The ratio l|2.21|l was originally derived by Sidi |122j for the construction of explicit ex- 
pressions for Pade approximants of some special hypergeometric series. However, Sidi's 
article |122j provides no evidence that he intended to use this ratio as a sequence transfor- 
mation. Moreover, I am not aware of any article of Sidi where the properties of the sequence 
transformation Sj^ (/3, s ni uj n ) were discussed or where it was applied. Later, Sj^ s„, u) n ) 
was apparently used in the master thesis of Shelef |121) for the numerical inversion of Laplace 
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transforms, but it seems that the results of this master thesis were not published elsewhere. 
The first refereed and generally accessible article, where an application of (|2.21|) as a se- 
quence transformation was described, is |151| , and the mathematical properties of (|2.21() as 
a sequence transformation and in particular its connection with factorial series were first 
discussed in |132l Section 8] . 

If we choose in (|2.12|) q m — £ — m + 1 with £ > 0, we obtain the following model 
sequence [1321 Eq. (9.2-1)] for the sequence transformation m["' (£, s n , u) n ): 



fc-1 

s n = s + u n V — ; ^ (2.22) 

= a+ ^g ? t^ = a + ^g_l_ ) fceN , neNo . (2.23) 

Thus, the corresponding annihilation operator is given by T = A fc (— £ — n)k-i and the 
sequence transformation Mjj? (£, s n , oj n ) can be expressed as follows [1321 Eq. (9.2-6)]: 

A fc [(-£-n)/._i/u; n J 
M (~£ - n-j) k -i s n+j 



Em 

3=0 



Em 

i=o 



i/ (-£ - n - fe)fc-i w„ +J 

, /c,n€N . (2.25) 



(~£ ~n- j) k - 



jj (-£ - ra - fe)fc_i w n+ j 



If we choose in (|2.12ll g TO = /3 + [m — l]/a with a, /? > 0, we obtain the following model 



sequence [1341 Eq. (3.1)] for the sequence transformation Cj^ (a,/3, s n , 
fc-i 

UJ. 



n Y — (2.26) 



k—1 j k — 1 i 

= s + w »EnnV = s + u »EnflTT' fceN ' »e N . (2.27) 

Thus, the corresponding annihilation operator is given by f = A k (a[P + n]) fc _i and the 
sequence transformation ej^ (a, 0, s„, u„) can be expressed as follows [1341 Eq. (3.2)]: 

n>(n), a \ p(n)/ fl , r ii/ \ A fe [(a[/3 + n] ) fc _is„/w„] 

e^(a,/3, S „,^) = & k \(3+[m-l]/a,s n ,u n ) = ^— ^ (2.28) 



Vf-lV f fc ^ (Q[/3 + n + j]) fc -i 



3=0 



'n+3 



j/ (a[/3 + n + ft])fc_i w„ +j 

/fc,neN . (2.29) 



y- f-1 y (k\ (a[/3 + n + j]) fc -i 1 
j=5 U7 (a[/3 + n + fc]) fc _i w n+j 

Depending upon the value of a > 0, the sequence transformation cjj. n '(a,/3, s n , u> n ) in- 
terpolates between S^" - ^/?, s n , w n ) and Levin's sequence transformation L^f 1 (/3, s n , w n ). If 
we choose a = 1 in (|2.29(l and compare the resulting expression with (|2.21|l . we find 

6^{l,!3,s n ,uj n ) = Si n) (/3,s„,w„), (2.30) 
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and if we use 

fe — 1 

lim ( a lP + n + tih-i = lim Y[ (fi + n + j + [m-l]/a) = (/3 + n + j)*" 1 (2.31) 

m— 1 

in l|2.29|l and compare the resulting expression with J2HHI, we find 

lim ei n) (a ) /9,s„,w n ) = ^(A^O- (2-32) 

a — >oc 

Thus, the construction of explicit expressions for the Levin- type sequence transforma- 
tions 5^\q m , s n ,u n ), ^ k n '(p,s n ,u> n ), §^ n) (/3,s n ,a; n ), 3Vt^(^, s n , w„), and (a, /?, s„, w„) 
with the help of annihilation operators is almost trivial. However, the annihilation operator 
approach does not only work in the case of the comparatively simple annihilating difference 
operators in (|2~T3|) . (j2~T7jl . {Ofy . l|23I)) . and Q2Bjl . In Q32 Section 7.4] it was shown that 
Richardson extrapolation |1()4) and Sidi's generalized Richardson extrapolation process |123| 
can be derived by using divided differences as annihilation operators. Then, it was shown 
by Brezinski and Redivo Zaglia 32,33 , Brezinski and Matos [3U], and Matos that the 
majority of the currently known transformations for scalar sequence can be derived via the 
annihilation operator approach. The generalization of this approach to vector and matrix 
sequences was discussed by Brezinski and Redivo Zaglia and Brezinski and Salam 35 . 



3 Recurrence Formulas 

In the theory of sequence transformations it is relatively uncommon that closed form expres- 
sions of the type of (|1.1|) . (|2.18|) . (|2.21() . (|2.25|) . and l|2.29|l are known. The majority of the 
currently known sequence transformations are defined and computed via recursive schemes. 
From a computational point of view, the lack of an explicit expression is normally no dis- 
advantage. The use of recurrence formulas is in most cases (much) much more efficient, in 
particular if a whole sequence of transforms must be computed simultaneously. 

It is an additional advantage of the annihilation operator approach described in Section 
12 that it permits a convenient construction of a recursive scheme for the numerators and 
denominators of S^ilm, Sn,u n ). For that purpose, let us define 

ri n) - T { ^{q mi u n ) = A k xi n} , fc,neN , (3.1) 
x (n) = X ^\q m ,u n ) = l[(n + q m )u n , k,neN . (3.2) 

m— 1 

Comparison with Ij2.13|l shows that corresponds apart from a missing phase factor 
(— l) fc to the numerator in (|2.15|l if we choose u n — s n /u> n , and to the denominator in (|2.15|) 
if we choose u n = l/u) n . 

The quantities satisfy for k > 2 the two-term recursion 

= (n + (3 .3) 
Next, we use the commutator relationship (see [HT] or [1321 Eq. (7.2-2)]) 

A k {n + qu-i) - (n + q k ^)A k = k E A^ 1 , (3.4) 
which can be proved by complete induction. This commutator can be rewritten as follows: 

A fc (n + <?fe-i) = {n + k + q k - 1 )A k +kA k - 1 (3.5) 

= [{n + k + q k _ x ){E- 1) + k] A^ 1 (3.6) 

= [{n + k + q k - X )E - (n + Qfc-i)] A*" 1 . (3.7) 
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Here, E is the shift operator defined by Ef(n) = f(n + 1). 
Combination of JOJ, lpH)l. (O and yields: 

rjW = A*(n + gfc-i)x£a (3.8) 
= [(n + fc + 9 fc_0 £ - (n + A fc ^ (3.9) 

= (n + k + q k -i) - (n + g fc _ x ) rjj^ , k > 2 , n G N . (3.10) 

Finally, we rescale rj^ according to 

4" } = G^(q m ,u n ) = , T f f {qm ^ n) . fc,n£N . (3.11) 

n m =i( n + fc +9m) 

If we combine (|3.10|l and l|3.11|l and take into account that 1)3. l|l and 1)3.2)) imply Tq™' 1 = 

(n) 

u n and = u n +i — u n , respectively, we obtain the following recursive scheme for the 
numerators and denominators of the sequence transformation (|1.1|) introduced by Cizek, 
Zamastil, and Skala Eq. (10)]: 

= u n , neNo, (3.12a) 
= u n+1 -u n , n e No , (3.12b) 

G& = Gi" +1) TT " + * + G <">, kN, nEN . (3.12c) 

rn — l 

If we choose u n = s n /u> n , this recursive scheme produces the numerator of l|l.l|) . and if we 
choose u n = l/w„, we obtain the denominator of (|l.ll) . 

As shown in [1321 Sections 7.3, 8.3, and 9.3], recursive schemes for the numerator and 
denominator sums of the sequence transformations (/3, s n , ui n ). S^™' (f3, s„, tu n ), and 
(£, s„,cj„) can be derived in the same way. The recursive scheme |132l Eq. (7.2-8))] 

4 n) = u n , neN , (3.13a) 



An) _ An+i) _ ([3 + n)(P + n + k) k 1 (n) 

H+i ~ H (/3 + n + fc + 1)fe ^ ' fc ' neN »' ^b) 



produces the numerator and denominator sums in (|2.18|) if we choose u n = s n /oj n and 
u n = l/ui n , respectively. We obtain l|3.13|l from I3.12fl by choosing q m — (3. 
Similarly, the recursive schemes [1321 Eq. (8.3-7))] 

= Un, n G N , (3.14a) 

c(») _ c(«+D _ (/3 + » + fc-l)(/^ + » + fc) s (n) , „ f3 ub s 

and 132, Eq. (9.3-6))] 

M^ n) = u n , neNo, (3.15a) 

Ml% = < +1) - f^TT M ^ fc ' neNo ' (3 - 15b) 

produce the numerator and denominator sums in 1)2.21)1 and 1)2.25)1 , respectively. The recur- 
sive schemes 1)3.14)1 and ()3.15)l can be obtained from 13.12)1 by setting q m — j3 + m — 1 and 
q m = £ — m + 1, respectively. 
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If we set q m = P+[m—l]/a in (|3.12|) . we obtain the recursive scheme for the interpolating 
transformation cl (a, /3, s ni uj n ): 

C^ n) = u n , neNo, (3.16a) 

C[ n) = u n+1 - u n , 7i e No , (3.16b) 
c (n) _ (n+i) _ (a[/? + n] + fc-l)(a[/3 + n + fc]) fc „ 1 {n) 

~ C k H/5 + n + fc+l]) fc Ck ' ( 3 - 16c ) 

This scheme produces the numerator and denominator sums of (|2.29() if we choose u n = 
s n /uj n and u n = 1/uJn, respectively. The recurrence formula published in |134l Eq. (3.3)] 
contains errors. 



4 Levin's Explicit Remainder Estimates 

It follows from (j2~T3|> . (j2~T4) . (|2~T7|) . jCTf . and (|2~2^|) that all sequence transforma- 

tions considered in this article can be expressed as follows: 

m(n), \ A k {Pk-i{n) s n /uj n } 

T ( k \s M ) = 1 K 1 , feeN, neN . (4.1) 

A {P k -i{n)/ujn\ 

Here, Pk-i(n) is a polynomial of degree k — 1 in n. Obviously, the remainder estimates 
{kj„}^L have to satisfy the minimal requirement that A fc {Pk-i{n) /co n } ^ for all finite 
k,n S No- In the following text, this will always be assumed. 

The weighted difference operator A fc Pk-i{n) in (|4.1() is linear. Accordingly, such a 
sequence transformation satisfies 



m(n), v A {Pk-i{n)[ Sn -8\ u n ) 

'{s ni uj n ) = s + 1 , — — — r fceN, neN . (4.2) 

A {P k -i(n)/u n \ 



This property of Levin-type transformations has some far-reaching consequences. Let us as- 
sume that we can find for a given sequence {s n }^L a sequence {w„}™ =0 of perfect remainder 
estimates such that 

s n = s + r n = s + cw„ , c ^ , ?i e N . (4.3) 

The polynomial Pfc_i(n) in (|4.1|) is of degree k — 1 in n, which implies that it is annihilated 
by A fe according to A k Pk-i(n) = 0. Accordingly, the transformation problem is now trivial 
since <|4.2[) produces the (generalized) limit s of the sequence 1)4 .3|) |1321 Theorem 12-8]): 

Tt\s n ,u n ) = s + J^' 1 ^ t - *, fceN, neNo. (4.4) 
A fe {Pfc_i(n)/a; n ) 

Unfortunately, perfect remainder estimates satisfying l|4.3|) can only be found for prac- 
tically more or less irrelevant model problems. In the case of realistic problems, we have to 
be more modest and can only hope to find remainder estimates that reproduce the leading 
order asymptotics of the actual remainders ' 1 321 Eq. (7.3-1)]: 

r n = s n — s = u>„ [c + 0(l/n)l , c 7^ , n — > oo . (4-5) 

This asymptotic condition does not fix remainder estimates uniquely. All Levin-type trans- 
formations considered in this article are invariant under the transformation uj n — > cw n with 
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c ^ 0. Moreover, given a sequence {r n }^ =0 of remainders it is usually possible to find a vari- 
ety of genuinely different sequences {ui n }^L , {^}^L , {w^}^L , ... of remainder estimates 
which all satisfy the asymptotic condition l|4.5|l . 

In some exceptional cases, explicit analytical expressions for remainder estimates can be 
found. Let us for instance assume that the elements of the sequence to be transformed are 
the partial sums s n = X)fc=o a k °f an infinite series and that the terms a& have a sufficiently 
simple analytical structure. Then it may be possible to derive an explicit expression for the 
truncation error, from which explicit remainder estimates satisfying l|4.5|) can be derived. 

In principle, such an analytical approach would be highly desirable, in particular since 
it should then be possible to construct for a given sequence {s n }^°=o m ore effective remain- 
der estimates {d)i^}^ that do not only reproduce the leading order asymptotics of the 
remainders according to l|4.5|l . but several of the leading orders according to 

r n = s n - s = [c + 0(n-')] , c^O, rc^oo, (4.6) 

where I > 1 is a fixed positive integer. Improved remainder estimates of that kind should 
lead to more efficient Levin-type transformations. Unfortunately, only relatively little work 
has been done on the asymptotics of truncation errors X)fcLn+i a & 01 infinite series as n — > oo 
beyond the leading order. Moreover, in many applications of Levin-type transformations 
in particular in physics, only the numerical values of a finite string of sequence elements 
or series coefficients are available, but no explicit analytical expressions. In such a case, 
remainder estimates have to be constructed from the numerical values of the input data via 
simple rules. 

Levin-type sequence transformations are not limited to strongly divergent perturbation 
expansions. They are able to accelerate the convergence of many series and sequences if 
suitable remainder estimates are used. In this context, it is helpful to introduce first some 
terminology which is common in the literature on convergence acceleration methods. Many 
practically relevant sequences {snj^o: which converge to some limit s, satisfy 

lim = s = lim = p. (4.7) 

n— >oo s n — S n—>oa r n 

If < \p\ < 1 holds, we say that the sequence {s n }^L converges linearly, if p = 1 holds, we 
say that this sequence converges logarithmically, and if p — holds, we say that it converges 
hyperlinearly. Of course, \p\ > 1 implies that the sequence {s n }^L diverges. 

On the basis of purely heuristic arguments Levin and later Smith and Ford |126j 
suggested some simple remainder estimates which according to experience nevertheless work 
remarkably well in a large variety of cases. These simple remainder estimates can be mo- 
tivated by considering simple model problems. For that purpose, let us assume that the 
elements of a sequence {s n }^L 01 partial sums 5Z"_ a v behave as follows: 

ax a 2 



z n+1 n 6 



n 



(4.8) 



This is a fairly general model sequence, which is able to describe the asymptotics of many 
practically relevant sequences as n — > oo and which Levin |90j had in mind when he intro- 
duced his simple remainder estimates. For \z\ < 1, the sequence (14.8(1 converges linearly to 
its limit s, for z = 1 and Re(6*) < 0, it converges logarithmically, and for \z\ > 1 it diverges. 

From l|4.8|l we obtain via a n = As„_i the leading orders of the asymptotic expansion of 
the terms of the infinite series J2T=o ^ or z = 1 an d Re(0) < (logarithmic convergence), 
we find with the help of the computer algebra system Maple 

'6a , {9 - l)[2ai - 9a ] 
2n~ 2 

i ufl™„ — 3™, n 

0(n~ 3 ) \, n^oo, (4.9) 



-2)[6a 2 + (^-l){fe -3a 1 }] IU , 



6n d 
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and for \z\ < 1 (linear convergence), we find. 

9ao + (z — l)a\ 



z n rf \ (z - l)a + 



+ 0(n~ 3 ) \, n->oo. (4.10) 



(g - 1) [2ai - gap] + 2(z - l)a 2 

If we compare l|4.8[) and (|4.9() . we see that in the case of logarithmic convergence the 
term a n — As„_i = 0(ri e_1 ) cannot reproduce the leading order of the remainder r n = 
s n — s = 0(n e ). However, the product na n — 0(n e ) reproduces the leading order of the 
remainder of the model sequence (|4.8|) . Thus, it is an obvious idea to use the remainder 
estimate jSU] 

w B = (/3 + n)As„_! = (P + n)a n (4.11) 

in Levin's general transformation (|2.18|) . yielding Levin's u transformation in the notation 
of [EH Eq. (7.3-5)]: 

u^\p,s n ) = 4 n) (A*n, (P + n) As n _i), fc,«eN„. (4.12) 

Since Levin's remainder estimate (|4.11|l reproduces the leading order of the remainder 
of the model sequence (|4.8ll for z = 1 and Re(0) < (logarithmic convergence), it is 
not surprising that the u transformation is an effective accelerator for many monotone, 
logarithmically convergent sequences and series. 

In the case of linear convergence (|z| < 1 in l|4.8|l ). the asymptotic expansion (|4.10(l 
indicates that the term a n itself and not the product na n would be a natural estimate for the 
truncation error in Q4.8|l . However, the Levin- type transformations considered in this article 
nevertheless accelerate convergence if instead of the "right" sequence {w„}^ of remainder 
estimates "wrong" remainder estimates uj' n = (n+/3) u) n with I 6 No are used (see Theorems 
12-14 - 12-16 and the discussion on pp. 310 - 311 of |132j '). The use of "wrong" remainder 
estimates only leads to a decrease of the efficiency of the transformation process (compare 
for instance [1321 Theorem 13-12]), depending on the magnitude of I. With the help of a 
generalization of Germain-Bonne's formal theory of convergence acceleration |64| it can be 
proved rigorously that the u transformation accelerates linear convergence [1321 Theorems 
12-10, 12-11, and 12-16]. 

Moreover, the u transformation is also capable of summing effectively many alternating 
divergent series. According to Smith and Ford |126II127| the u transformation is among 
the most versatile and powerful sequence transformations that are currently known. This 
explains why Levin's u transformation is used internally in the computer algebra system 
Maple in the case of convergence problems (see for example 0^1 PP- 51 and 125] or |711 p. 
258]). 

The remainder estimate (I4.11|) can also be inserted into the explicit expressions l|2.21|l . 
623 , and I2T59I for (/3, s„, u n ), (£, s n , w n ), and e^ l) (a, (3, s n , u n ), yielding the 
w-type variants [T52l Eqs. (8.4-2) and (9.4-2)] 

y^(l3,s n ) = S^GS.an.CS + nJA^-i), fc,neN , (4.13) 
^ (7 %s n ) = M^ n) (e,s n ,(-e-n)A S „_ 1 ) ! fc,neN , (4.14) 
„ei n) (a,/3, S „) = ei" ) (a,/3, S „,(/3 + n)As„_ 1 ), k,neN . (4.15) 

In the case of the sequence transformation s£ (q m , s n ,uj n ) introduced by Cizek, Zamastil, 
and Skala 48, Eq. (10)] we choose the u-type remainder estimates according to 

oj„ = (n + q )As n _i = (n + q )a n , (4.16) 
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where qo > is a suitable constant. Inserting this into l|l.lfl yields: 
u Si n) (<?m,s„) = 9j?\qm,s n , (n + q )As n -i) 

A\ TT (n + j + q m ) Sn+j 

_ H W iii + k + 1m) (" + 3 + 5o)As n+i _ 1 



ec-^C) n 

7=0 VJ/ m=l 



1 (n + j + q m ) 1 

jS (n + + g m ) (n + j + qo)As n+ j-i 



k,n£N . (4.17) 



As discussed in more details in Section (see the discussion following (|6.13(l ). this w-type 
transformation looses some important exactness properties if qo > is essentially arbitrary 
and does not satisfy qo G {q\, . . . , q m } because then [17^1=1 ( n + Qm)] /( n + Qo) is rational in 
n and does not simplify to a polynomial of degree k — 2 in n. Thus, an obvious idea would 
be to choose qo — q\. The other u-type transformations Q4.12p . I|4.13[l . (|4.14|) . and (|4.15|) 
satisfy this requirement. 

The asymptotic expansion 1(4. 10[) indicates that in the case linear convergence the term 
a n is a natural estimate for the truncation error of the sequence H4.8[) with \z\ < 1. Thus, 
Levin proposed for linearly convergent sequences and series the remainder estimate 

uj n = As„_i = a n , (4-18) 

which yields Levin's t transformation in the notation of (1321 Eq. (7.3-7)]: 

4 K) (/W = L l k\p,8 n ,As n -i), k,neN . (4.19) 

The t transformation is an effective accelerator for linear convergence and in particular 
for alternating series [12611127) . With the help of a generalization of Germain-Bonne's 
formal theory of convergence acceleration |64| it can be proved rigorously that Levin's t 
transformation accelerates linear convergence [1321 Theorems 12-10, 12-11, and 12-16]. It 
is also able to sum many alternating divergent series. However, a comparison of (|4.8|l and 
(|4.9I) indicates that the t transformation should fail to accelerate logarithmic convergence 
(for more details, see [1321 Theorem 14-1]). 

The use of the remainder estimate (I4.18|) in the explicit expressions l)2.21[l . (12.25(1 . and 

(EU for 4 n) (/3, S „,w„), m£°(£, oj n ), and 6*. (a, 0, s n , w„) yields the t-type variants 
132, Eqs. (8.4-3) and (9.4-3)] 

7*°(ft* n ) = Sj^GS^n.Asn-i), k,neN , (4.20) 
Tk n \t,sn) = M<£\z, Sn ,As n ^), fc,n£N , (4.21) 
t e£\a,0,a n ) = ei" ) (a,/?,s„,As„_ 1 ), fc,n£N . (4.22) 

In the case of the sequence transformation S^\q m , s ni uj n ) we obtain in this way: 

Su (Qm,s n ) = S[ n \q m ,s n ,As n ^i) 

J2(-iy f k \ f[ ( n + 3+1rn) S n +j 



3=0 



1=1 ( n + k + q m ) Asn+j-i 



3=0 



k, n e N . (4.23) 



3) „ii (n + k + q m ) As n+j - 



Inspired by Aitken's A 2 formula pQ, Levin jHO] introduced as a third simple remainder 
estimate 

As n _ 1 As n _ a n a n +i , 

w n a a ■ 1,4. z4J 
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The usefulness of this remainder estimate can be demonstrated by applying it to the model 
sequence (|4.8[l . For ( = 1 and Re(#) < (logarithmic convergence) we obtain 



&n — 



= 71" < - 



9ao 
9-1 



- 1)71 



fgq (0-2)q 2 
j \ 12 6»-l 



0ao 



- I n 2 



Of 



(4.25) 



and for \z\ < 1 (linear convergence) we obtain 



a 



Oi 



z9a>o 



a 2 



■0(71- 



(4.26) 

It is a remarkable feature of the remainder estimate (|4.24(l that it does not only reproduce 
the leading order of the model sequence l|4.8|) , but both in the case of linear and logarithmic 
convergence also the next one. Thus, the reminder estimate (|4.24|) is in the case of the model 
sequence (|4.8|1 a remainder estimate of the type of <|4.6|) with 1 = 2, whereas Levin's other 
two remainder estimates (|4.11|) and i|4.18[) only satisfy Of course, it would be desirable 

to find other remainder estimate which are also able to reproduce more than the leading 
order asymptotics of the truncation error. Further research into this direction should be of 
considerable interest. 

The use of the remainder estimate (I4.24f) in (|2.18|) yields Levin's v transformation in the 
notation of (EH Eq. (7.3-11)]: 



(/3,s„) = ^\(3, s„, As„_iAs„/[As„_i - As„]) , k,n £ 



(4.27) 



Levin's v transformation is an effective accelerator for many linearly and logarithmically 
convergent sequences and series. With the help of a generalization of Germain-Bonne's 
formal theory of convergence acceleration [S3] it can be proved rigorously that the v trans- 
formation accelerates linear convergence |132l Theorems 12-10 and 12-11]. The v trans- 
formation is also able to sum many alternating divergent series. According to Smith and 
Ford 126, 127 , the v transformation has similar properties as the u transformation, which 
means that it is among the most versatile and powerful sequence transformations that are 
currently known. 

The use of the remainder estimate (I4.24f) in the explicit expressions (|2.21|) . (I2.25f) . and 

(|2.29() for Sj. s n , uj n ), M^™' (£, s n , uj n ), and C^\a, (3, s n , uj n ) yields the f-type variants 
132, Eqs. (8.4-5) and (9.4-5)] 



>(n) 



iei n) (a,/3,s„) = ei n) (a,/3, Sn ,A s „_ 1 A s „/[As„_ 1 -A s „]) 

»(«)/ 



k,n £ N , 
k,n £ N . 
k,n£ N . 



(4.28) 
(4.29) 
(4.30) 



In the case of the sequence transformation S k {im, s ni ^n) we obtain 

As„_iAs„/[As„_i - As n ]) 



k 

Ec- 1 ) 

3=0 



fc-1 

n 



(n + j + 

) (A S n-\-j — l ^Sn-\-j ) 



n+j )*n+j 



•± (n + k + q m ) 



-lAs 



n+j 



k 

E 

3=0 



(-iy 



k-l 



n 



(n + j + q m ) As n+j -i - As 



k, n £ 



(4.31) 



n+j 



■ (n + k + q m ) As 

n — 1 A S n j 
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The best simple estimate for the truncation error of a strictly alternating convergent 
series is the first term not included in the partial sum |881 p. 259]. Moreover, the first 
term neglected is also an estimate of the truncation error of a divergent hypergeometric 
series 2-Fb( a i b, —z) with a, b, z > |38l Theorem 5.12-5]. Accordingly, Smith and Ford |126| 
proposed the remainder estimate 

uj n = As„ = a n , (4.32) 

This remainder estimate can also be motivated via the model sequence Q4.8JI . For z = 1 and 
Re(6*) < (logarithmic convergence), we find 



e f6a a (0-1)120! + Baa] 

= n \— + 2^ 

(fl-2)[6a 2 + (fl-l){fla + 3ai}] 
6n 3 

and for \z\ < 1 (linear convergence), we find. 

,n+i„e \t„ -n„. , z9a o + ( z - l)ai 



0(n _J H, n^oo,(4.33) 



a„+i = z n+i n s (z - l)a + 



n 

1) [2ai + 9a } + 2(z - l)a 2 
2^2 



O^rT 6 )), n-^oc.(4.34) 



The use of the remainder estimate (I4.32|) yields Levin's d transformation in the notation 
of [HI Eq. (7.3-9)]: 

4 n) C9,«») = ^\^s n ,As n ), fc,B£N . (4.35) 

If we compare (I4.33|) with !|4.9[> and l|4.34|) with l|4.10|l . we see that Levin's d trans- 
formation should have similar properties as Levin's t transformation. This is confirmed 
by experience: The d transformation is a powerful accelerator for linear convergence and 
in particular for alternating series, and is also able to sum many alternating divergent se- 
ries, but fails to accelerate logarithmic convergence. With the help of a generalization of 
Germain-Bonne's formal theory of convergence acceleration |64| it can be proved rigorously 
that the d transformation accelerates linear convergence [1321 Theorems 12-10, 12-11, and 
12-16]. 

The use of the remainder estimate (I4.32|) in the explicit expressions l]2.21[l . (I2.25|) . and 

(|2.29|) for §j^(/3, s n ,ui n ), M^"'(£, s„, uj n ), and (a, /3, s n , w n ) yields the d-type variants 
132, Eqs. (8.4-4) and (9.4-4)] 

6[ n \f3,s n ) = §i n) (f3,s n ,A Sn ), k,neN , (4.36) 
A^itsn) = M{ n) (^s n ,A Sn ), k,neN , (4.37) 
rf ei" ) (a,/3,s„) = ei n) (a,/3,s„,A S „), fc,neN . (4.38) 

As already mentioned in Section ^ t ne delta transformation (|4.36l) was found to be 
particularly powerful in the case of factorially and hyperfactorially divergent alternating 
power series as they for instance occur in the perturbation expansions of quantum physics 
|1 7I46I47I48I77I83I1 3211 3311 3411 3511 3611 3711 3811 3911 41 11 4211 4411 4811 45j or in asymptotic 
expansions for special functions 133 136, 140"l ll47| '). 
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In the case of the sequence transformation 5 k (q m -> s n ,Lu n ) we obtain 



(n). 



EC- 1 ) 

3=0 



k\ rr (n + j + q m ) s r , 
V i , {n + k + q m ) As n+] 



k\ tt (n + j + gm) 1 



J=0 



i,nSN 



(4.39) 



for 



In practical applications it happens relatively often that asymptotic expressions a„ 
the terms a n of a series are known that reproduce the leading order of a n as n — > oo. For 
example, the coefficients c„ of many divergent perturbation expansions, which are power 
series in some coupling constant g, satisfy (see for example [H21 Table 1]) 



(-l) n T(an + b)R n [C + 0(l/n)] , 



oo . 



(4.40) 



where a, 6, C, and i? are known constants. 

The remainder estimate 1)4.24(1 . which leads to Levin's v transformation, is in some sense 
exceptional since reproduces not only the leading order of the truncation errors of the model 
sequence l|4.8f) as n — > oo, but also the next one. Normally, we can only expect that the 
simple remainder estimates 1(4.11(1 . (|4.18|) . (14.24(1 . and ((4.32(1 reproduce the leading order of 
the remainder s n — s. However, the leading order of the truncation error is also reproduced 
if we use in (14. 1 IB . 1(4.18(1 . 14.241 . and 1(4.32(1 not a n and a n+ i but their limiting expressions 
g4°°' 1 and a^\. Whether this improves the transformation results or not, depends on the 
problem under consideration and cannot be decided by simple considerations. Nevertheless, 
it may well be worth a try. Ideas of that kind were discussed in more details in |751135| and 
also by Cizek, Zamastil, and Skala |48|. 

The i-type transformations [(4~T9jl . (|4"2TT|) . (|4"2l"|) . and (|4^|) use the last term a n 

of the partial sum s n — X)fc=o a k as an estimate for the truncation error r n = — X)fe^n+i 
whereas the analogous d-type transformations 1(4.35(1 . ((4.3(jl) . ((4.37|) . 1(4.38(1 . and ((4.39(1 use 
the first term a n+ i not included in the partial sum as the remainder estimate. Thus, it looks 
that i-type transformation utilize the available information in some sense more effectively 
than d- type transformation since they use a n +i also for the construction of the next partial 
sum s n +\. This is, however, a superficial judgment and it can be shown easily that t-type 
transformations are actually <i-type transformations is disguise. 

All t-type transformations of this article can be expressed as follows: 



t T fc (n) (s„, As n _i) 



A k [P fc -i(n) a n /As n _i] 
A fc [P k ^(n)/As n ^] 



^2(-iy p fe _!(n+i) 



3=0 



+J-1 



(4.41) 



k e N , n e N ■ (4.42) 



As usual, Pk-\{n) is a polynomial of degree k — 1 in n. 

Let us now use the relationship s n = s n _i + As n _i in the numerator on the right-hand 
side of 1(4.41(1 . In view of the linearity of A fc we then obtain: 



A fc Pfc - l(n)S " = A M^-i(") 
As„_i 



As„. 



As„_i As„_i 



= A 



k P k -i{n)s r , 



As„_i 



(4.43) 
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Inserting this into (|4.41|l and (|4.42|) shows that a t-type transformation is actually a d-type 
transformation with a transformed polynomial J'fc_i(n — 1) = Pk-i(n): 



rUn), a \ _ ^ [J>k-i(n - 1) s n _i/As„_i] 



A* pPjk-xfn-lJ/Aan-i] 



EM) 



As 



n+j-1 



EM) 

j=0 



(4.44) 



(4.45) 



0Vl(n + j- 1) 



As„ 



Thus, the i-type transformations defined in l)4~T0|) . 1 (00) 1. ()4"2l")) . (JOS, and l)Q5)l can 

be expressed by the corresponding <i-type transformations defined in 1)4. 35)1 . 1)4.36(1 . 1)4.37(1 . 
and (|4.39|) according to 

(4.46) 
(4.47) 
(4.48) 
(4.49) 
(4.50) 

In these expressions, the case n = deserves special consideration. Since we tacitly 
assume s_ m = with m 6 N, the term with j = in the numerator sum of (|4.45|l vanishes 
for n — 0. This can also be proved directly from the numerator sum in (|4.42H . If we write 
there As„+j_i = a n +j and s n +j — S™=o we obtain for n = 0: 



t { k n \(3,s n ) = 


4 n ~ 




Mn-l, As n _i) = 


4 n-1) (0 + Mn-l), 


4 n \p,s n ) = 






1, Sn-li As„_i) = 


4"- 1) (/3 + l, s „_ 1 ), 




Mi" 




1, s„_i, As„_i) = 


A^^+l.Sn-i), 


e ( k n \a,(3, Sn ) = 




1} (a,/3 


+ 1, s„_i, As„_i) 


= d ei n) (a, /3 +l,s„_i), 


t 5 { k\i m ,s n ) = 


st 




1- 1, s„_i, As„_i = 


dSfc (?m + 1, Sn-l) ■ 



=n J 



i/=0 



3=0 



EH) 3 C)M)E^- 



i/=0 



(4.51) 
(4.52) 



Here, we made use of the fact that y^,_ Q is for j = an empty sum which is zero. Thus, 
for n = the general t-type transformation 1)4.42(1 can be expressed as follows: 



E 

*lf>(.o,A*-i) = ^ 

E 

j'=o 
k 

E 

i=i 



As,, 



Pk-iV)- 



As 3 _! 



As,, 



EM) 



n-i(i-i) 



i 



As,_i 



ken. 



(4.53) 



(4.54) 



The fact that t-type transformations are actually d-type transformations in disguise can 
also be deduced from the recursive scheme (|3.12|) which contains all the other recursive 
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schemes of Section[3]as special cases. If we choose the initial conditions in (|3.12a|) according 
to u n — s„/As„_i, then (|3.12b|) implies = A[s„/As„_i] = A[s„_x/As„_x]. Thus, 

(|3.12cll with k > 1 yields the same results as if we had started the recursion with the d-type 
initial conditions u n — s„_ 1 /As„_ 1 . 

Numerical cancellation increases the risk of loosing accuracy. Thus, it is probably wiser 
not to use the i-type initial conditions u n = s„/As n _i in the recursive scheme Ij3.12|) or in 
any of its special cases, but instead the d-type initial conditions u n — s n _i/As n _i. 

5 Richardson- Type Transformations 

Some of the most effective accelerators for logarithmically convergent sequences and series 
(p = 1 in i|4.7[l ). which abound in scientific applications and which constitute formidable 
computational problems, can be derived with the help of interpolation theory. Thus, the 
existence of a function S of a continuous variable is postulated which coincides on a set of 
discrete arguments {i n }™=o with the elements of the sequence {snj^Q to be transformed: 

S(x n ) = s n , neN - (5.1) 

This ansatz reduces the convergence acceleration problem to an extrapolation problem. If 
a finite string s n , s n +i, . . ., s n +fc of fe + 1 sequence elements is known, one can construct an 
approximation Sk{x) to S(x) which satisfies the k + 1 interpolation conditions Sk(x n +j) = 
s n+ j with < j < k. Next, the value of Sk(x) has to be determined for x — > Xoq. If this can 
be done, Skixoc) should provide a better approximation to the limit s — of the sequence 
{ s n}5^Lo than the last sequence element s n +fc used for its construction. 

The most important interpolating functions are either polynomials or rational functions 
which lead to different convergence algorithm (see for example [1321 Section 6]). Here, 
only polynomial interpolation will be considered. Thus, it is assumed that the fc-th order 
approximant Sk(x) is a polynomial of degree k in x, 

Sk(x) = 70 + lix + ■ ■ ■ + lkx k , keN, (5.2) 

or equivalently that the model sequence for the Richardson extrapolation scheme |l()4j . 
whose construction will be sketched below, is a polynomial of degree k in the interpolation 
points x n , 

fe-i 

s n = s + ^2 c,jx n 3+1 , k e N , n G N . (5.3) 

j=o 

For polynomials, the most natural extrapolation point is x^ = 0. Accordingly, we 
assume that the interpolation points x n satisfy the conditions 

x Q > x x > ■ ■ ■ > x m > x m+ i > • • ■ > , (5.4a) 
lim x n = 0. (5.4b) 

n — >oo 

The choice Xoo = implies that the approximation to the limit s = Sco in H5.3(l is to be 
identified with the constant term 70 of the polynomial (|5.2|) . 

Several different methods for the construction of interpolating polynomials Sk(x) are 
known (see for example |501 Chapter III] ) . Since we are only interested in the constant term 
70 of an interpolating polynomial Sk(x) and since in most applications it is desirable to 
compute simultaneously a whole string of approximants Sq(0), S\(0), 6*2(0), .. . with increas- 
ing polynomial degree, the most economical choice is Neville's scheme |93] for the recursive 
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computation of interpolating polynomials. If we set x = in Neville's scheme, we obtain 
the following recursive scheme (see for example p. 73] or [1321 Eq. (6.1-5)]): 

N^\s n ,x n ) = s n , neN , (5.5a) 

•Nfe+i(s„,a;„) = s _ « 5 /c, ?ie N . (5.5b) 

In the literature on convergence acceleration, this variant of Neville's scheme is called 
Richardson extrapolation jl()4j . In |1321 Section 7.4] it was shown that this recursive scheme 
can also be derived with the help of the of the annihilation operator approach described in 
Section [21 by using divided differences as annihilation operators. 

In most applications, Richardson extrapolation is used in combination with the inter- 
polation points x n = l/(n + (3) with (3 > 0. Then, the model sequence l|5.3|l assumes the 
following form: 

1 fc_1 c 

s n = s + — — JoT Vi ' fceN ' neN °- ( 5 - 6 ) 
p + n p-^ (fj + ny 

This model sequence can be obtained from the model sequence (12.16(1 for Levin's sequence 
transformation by setting lu u = l/(/3 + n). Consequently, N^ with x n = l/(/3 + n) is a 
special Levin transformation and can be expressed as the ratio of two finite sums according 
to (|2.18l) . Since, however, the denominator of the ratio l|2.18|l can for ui n = l/(/3 + n) be 
expressed in closed form, possesses an even simpler closed form expression as a finite 
sum (sec for example HU Lemma 2.1, p. 313] or |T32l Eq- (7.3-20)]): 

Ai%, s „) = Ni n) ( s „,l/(/3 + n)) = ££(/3 >Sw ,l/(/? + n)) 

= (-l)^(-iy ^ + n + y Sn+ ,, k,neN . (5.7) 

Moreover, the recursive scheme (|5.5f) assumes the following form [1321 Eq. (7.3-21)]: 

A n) (/3,s„) = s n , neNo, (5.8a) 
A&OW) - Ai" +1) (/3, Sn+1 ) + ^AA[ n \f],s n ), fc,neN . (5.8b) 

In the case of doubly indexed quantities like A*! it is always assumed that A only acts on 
the superscript n but not on the subscript fc, i.e., AA!l = A.. n+1 ^ — A^ . 

It is also possible to construct in the case of the sequence transformation l|l.lfl introduced 
by Cfzek, Zamastil, and Skala 48, Eq. (10)] a Richardson-type variant. For that purpose, 
we set in the model sequence (|2.12f) oj n = l/(n + q ), where q$ is a suitable constant, yielding 



s n = s + V — ^ -, k,ne N . (5.9) 

Thus, A k nt7=o( n + 1 m ) 1S tne annihilation operator for the remainder of this model se- 
quence, yielding the following Richardson-type variant of the sequence transformation in- 
troduced by Cizek, Zamastil, and Skala (33 Eq. (10)]: 

i \ r>M / i \ ^ [Ilm=o( n + 9m) s ri] , _ M / c 

R% {q m ,s n ) = Sfc (q m ,s n ,n + q ) = — L ,_ 1 -± , k, n G N . (5.10) 

A ]lm=o(" + 9™) 
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Of course, this transformation can be expressed as the ratio of two finite sums according 
to (|1.1|) . However, the denominator of l|5.10|l can be expressed in closed form. First, we 
observe that the products in the difference operator representation i|5.10[) are polynomials 
of degree k in n, satisfying 

k-l 

n ( n + Irn) = n k + {q Q + qi + ... + qk-lh^ 1 + ... . (5.11) 

Next, we use the well known relationship A k n k — kl, which can for instance be derived by 
iterating the commutator relationship (|3.4|> . and take into account that all polynomials of 
degree 0, 1, k — 1 inn are annihilated by A fc . Thus, 

fc-i 

A fc Y[(n + q m ) = kl. (5.12) 

With the help of (|2~Ti|) we then obtain from (|5~TUJl : 
i?Si n) (<7m, s n ) = 9 { k \q m ,s n ,l/(n + q )) 

= (-l) fc J2(-iy U "^?l + J + qm) s n+j , k,neN . (5.13) 

If we set here q rn — /3, we obtain the sequence transformation l|5.7|) according to 

«s£° (/?,*») = g£ n) (/?, S „,l/(/? + n)) = Ai%, S „), k,neN . (5.14) 

We can derive a recursive scheme for r 1 ^^ {q m , s n ) by means of the techniques described 
in Section^ For that purpose, we express the numerator of the ratio on the right-hand side 
of l|5.10|l as follows: 

Q [ k ] = Qi n \qm,s n ) = A fc r fe (n) , ^eN„, (5.15) 

Y (n) = y(n) ^ = JJ („ + q m ) Sn , k, n e No . (5.16) 



(n) 

The quantities Yu satisfy for k > 1 the two-term recursion 

Yt n) = (n + q k ^)Yt\. (5.17) 
Next, we combine (|5.15ll - (|5.17f) with the commutator relationship (|3.7|) . yielding 

= A k (n + q k ^)Y^_\ (5.18) 

= [(n + k + 9fc _i) E — (n + q k -i)] A^ 1 y£\ (5.19) 

= (n + k + q k ^) Q^+p - (n + q k _{) Q { £\ , k e N , n £ N . (5.20) 

Now, we only have to divide the recurrence formula l|5.20|l for the numerator of l|5.10|l by 
the denominator according to l|5.12|l to obtain the recursive scheme 

flSi 0) (<7m, Sn) = s n , n S N , (5.21a) 

flSiiCWn) = flSi" +1) (<z m , S „+i) + ^-^A R 9 k n \q m ,s n ), fc,neN . (5.21b) 



Ernst Joachim Weniger: A New Levin- Type Sequence Transformation. I. 



5: Richardson- Type Transformations 



22 



If we choose in (|5.21ll q m = f3, we obtain the recursive scheme l|5.8() for Ajp(/3, s„). 

By specializing the parameters q m in (|5.13|l and (|5.21() . other Richardson- type transfor- 
mations and their recursive schemes can be obtained. If we choose q m — \ + m i we obtain 
the Richardson-type variant of the sequence transformation (|2.21|l |132l Eq. (8.4-11)]. 

^\x,s n ) = BBi n) (x + m,s n ) = S[ n) (x + l,sn,l/(x + n)) 

= (-l) k ]T ^u^-v" s -+i > k,neN , (5.22) 



and its recursive scheme [1321 Eq. (8.4-12)] 



?t\x,sn) = s n , nGNo, (5.23a) 
?[ n Mx, s n ) = ?i" +1) (x, + X+ k l^ k A ^" } ^' S ") ' k,neN . (5.23b) 

If we choose in (|5.13|) and l|5.21|l q m — ( — m, we obtain the Richardson-type variant of 
the sequence transformation (|2.25(1 132*1 Eq. (9.4-11)], 

^(C,*™) = flSl n) (C-m, S „) = Mi n) (C-Mn,-l/(C + n)) 

= £ (-^ ( ~MrT"~M )fc s "+^ ' fc < n G N ° ' (5 ' 24) 

and its recursive scheme [1321 Eq. (9.4-12)] 

?o n) (C,.s«) = s n> neNo, (5.25a) 

ygiCC^n) = yi" +1) (c,^+i) + c ^"~ fc Ayi n) (c, an ), fc,neN . (5.25b) 

If we choose in (|5.13|l and l|5.21|l q TO = x + m/a, we obtain the Richardson- type variant 
of the sequence transformation (|2.29|l . 

R e * : («)X)Sn) = flS£ (x + m/a,s„) = rC^ (a, X + 1, s„, l/(x + n)) 

= ^ E (-I)' (Q[X ,r + J Dfc -M* , M € No , (5.26) 

and its recursive scheme 

R e { n) (a,x,s n ) = s n , neN a , (5.27a) 

(5.27b) 

Depending upon the value of a > 0, #Cj^ (a, s„) interpolates between the Richardson- 
type transformations Ajj™^(/3, s„) and 3^\xi s n)- If we choose in l|5.26|) a = 1 and compare 
the resulting expression with (|5.22|) , we find 

R e^{l,x,s n ) = 3tHx,Sn), (5.28) 

and if we use in (|5.26() 

Um (a[x + n + j]) k = Hm TT (x + n + j + ml a) = ( X + n + j) k (5.29) 

m=0 
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together with x = P an d compare the resulting expression with (|5.7|l , we find 

lim R e { k n \a,(3,s n ) = A[ n) (f3,s n ). (5.30) 

ol — »oo 

6 Rational Approximants 

In theoretical physics and in applied mathematics, Pade approximants |99j have become the 
standard tool to overcome problems with slowly convergent or divergent power series. Pade 
approximants can also be viewed as a special class of sequence transformations since they 
transform the partial sums 

n 

fn(z) = ^7^, " GNo ' 
i/=0 

of a (formal) power series for some function / into a doubly indexed sequence of rational 
functions (see for example O Chapter 1]): 



pUM( z ) _ PQ + Pl z + ...+ 



[l/mh{z) = = ™ ' ^ ' ' PlZ , l,mgN . (6.2) 

JJW QW™\{z) l + q lZ + ... + q m z m V J 

We also obtain rational approximants if the u, t, d, and v variants considered in Section 
B]are applied to the partial sums Nevertheless, there are some substantial differences 

between most sequence transformations and Pade approximants. Levin-type transforma- 
tions can be computed via their explicit expressions, although it is normally preferable to 
compute them recursively. The coefficients po, ■ ■ ■ , pi and qi, . . . , q m of the two Pade 
polynomials p['/ m l and in are, however, chosen in such a way that the Taylor 

expansion of the ratio p['/ m l(z)/Q['/ m l(z) at z = agrees with the power series for / as far 
as possible: 

Q^ m \z)f{z) - pW m \z) = 0(z l+m+1 ), z^O. (6.3) 

This asymptotic condition leads to a system of I + m + 1 linear equations. If this system of 
equations has a solution, it yields the coefficients of the polynomials p['/ m l(z) and Q^ l / m \z) 
(see for example Chapter 1]). 

In most practical applications, Pade approximants are not computed via the defining 
system of equations, but with the help of recursive algorithms as for example Wynn's epsilon 
algorithm |153| . Nevertheless, the accuracy-through-order relationship i|b.3fl guarantees that 
the Taylor expansion of [l/m]f(z) reproduces the partial sum fi +m (z) from which it was 
constructed. If a sequence transformation is applied to the partial sums of a (formal) power 
series, it is by no means obvious whether the resulting expression satisfies an accuracy- 
through-order relationship of the type of l|6. 3J) (see for example the discussion in |143j ). 

The accuracy-through-order relationship (|6.3|) is essential if Pade approximants are to 
be used for the prediction of unknown series coefficients, which was first described and 
utilized by Gilewicz This so-called Pade prediction is based on the fact that a Pade 

approximant is by construction analytic at the origin. Accordingly, the power series 

oo 

[l/m} f (z) = J2^ /m]zV ( 6 - 4 ) 

converges in a neighborhood of z — 0. The accuracy-through-order relationship (|6.3(l implies 
^W m ] _ ^ £ or o < < Z + m. The remaining coefficients jf^^^^ with fx > are in 
general different from the corresponding coefficients 7/+ m +/.(+i of the power series for f(z). 
If, however, the Pade approximants [l/m]f(z) converge more rapidly to f(z) than the partial 
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sums fi +m (z), from which they are constructed, then the coefficients 7;_|L™J)_„_|_ 1 provide in 
particularly for smaller values of fi approximants to the corresponding series coefficients. It 
is important to note that Pade prediction is not restricted to convergent power series. Thus, 
Pade prediction can produce useful results even if the power series is a factorially divergent 
perturbation expansion. 

In certain subfields of theoretical physics, the computation of more than a few coefficients 
of a perturbation expansion can be extremely difficult. Moreover, these coefficients are 
often affected by comparatively large relative errors. Under such adverse conditions, Pade 
approximants can be used to make predictions about the leading unknown coefficients of 
perturbation expansions as well as to make consistency checks for previously calculated 
coefficients. Further details as well as many examples can be found in 9 : 36 : 39 : 40 : 41 , 42 , 43 
l44lllll5lTCT?77IICT^ and in references 

therein. Pade prediction can also be quite helpful in different contexts. For example, Pade 
prediction techniques developed in 133 were used in 0| to provide numerical evidence 
that the factorially divergent perturbation expansion for an anharmonic oscillator, whose 
Hamiltonian is non-Hermitian but IPT-symmetric 0, is a Stieltjes series. 

The prediction of unknown power series coefficients is not restricted to Pade approxi- 
mants. In principle, any other rational approximant, that also satisfies an accuracy-through- 
order relationship of the type of l|6.3[) . can be used. It seems that this idea was first formu- 
lated by Sidi and Levin |124j and by Brezinski |23| . Recently, it was found that Levin- type 
transformation like (|4.35|) and (|4.36(l . which satisfy for k € N and n £ No the following 
asymptotic order estimates as z — > 1 19. Eqs. (4.28) and (4.29)], 

f(z) - 4 n) (/3,/„(z)) = 0(z fc +"+ 2 ), (6.5) 
f(z) - 6l n) ((3J n (z)) = 0(z fe+ "+ 2 ), (6.6) 



produce at least in some cases significantly more accurate predictions for unknown power 
series coefficients than Pade approximants [77ll83U142j . Accordingly, it should be of interest 
to analyze not only the rational approximants, which result if Levin-type transformations 
are applied to power series, but also their accuracy-through-order relationships. In the case 
of Levin's t transformation, this was already done by Sidi and Levin |124| , and the accuracy- 
through-order relationships for the u, t, v, and d variants of £^ (/?, s n , u n ), (/?, s n , w n ), 
and Mj^(£, s n ,aj n ) were studied in |136l Section 5.7], albeit by a less elegant method. 

In this Section, the u, t, v, and d variants of the sequence transformation 9j™^ (?m, s n , ui n ) 
introduced by Cizek, Zamastil, and Skala |48l Eq. (10)] are applied to (formal) power se- 
ries and the accuracy-through-order properties of the resulting rational approximants are 
studied. Since the sequence transformations (/3, s n , u> n ), Sj^ s n , u> n ), 3YCj."'(^, s n , co n ), 
and G^\a, P, s n ,uj n ) can be obtained from (<7m, s m w n ) by specializing the parameters 

q m , all results for uS^ 1 ' (q m , f n {z)), &k {im, fn{z)) , dSi™ ) (q m ,f n {z)), and^Sj^ (q m , f n {z)) 
derived here can immediately be translated to the analogous results for the u, t, d, and v 
type variants of the transformations mentioned above. 

If we use the partial sums (|6.1|l of a (formal) power series f(z) = X^=o 1" z " as m " 
put data, the simple remainder estimates l|4.16|l . (|4.18|) . (|4.24|) . and 14.32|l for the u, t, 

v, and d variants of S^ilm, s n ,uj n ) translate to w„ = [n + qo)j n z n , u> n = j n z n , w„ = 
7ri7ri+i2 ,i+1 /[7„ — zj n+ i], and oj n — ■y n+ iz n+1 . Of course, these remainder estimates can 
only be used if the coefficients of the power series for / satisfy 7„ ^ for all n € No- In the 
following text, this will be tacitly assumed. 

If we apply the u variant Q4.17[l of 5^ (<?m, s„, ui n ) to the partial sums l|6.1|) of the 
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(formal) power series for /, we obtain: 

u9 k n) (q m ,fn(z)) = *3t ) (q m ,fn{z) 1 {n + q Q )-1 n Z n ) 

1 {n + j + q m ) z k ~:> f n+3 (z) 



ehf n 



3 J mil {n + k + q m ) {n + j + q Q )j n+3 
(n + j + q m ) Z k ~ j 



— -^g- : : , k,nen Q . (6.7) 



§ ( W III ( n + k + «"») + + »)7»+j 
In the case of the i variant (|4.23|) of S k (q m , s„,cj„), we obtain: 



(n + k + q m ) j n+j 



j'=o 



fc,neN . (6.8) 



J/ m=l ( n + k + <lrn) Jn+j 



In the case of the d variant l|4.39[l of $ k (q m , s n ,u> n ), we obtain 
S { k n) {q m Jn(z)) = Si n) (q m J n (z), 7n+1 z n+1 ) 



fc /, x 



3=0 



3/ roil («- + ^ + <7m) 7™+j 



+ 1 



fc /, \ fc-1 



J=0 



fc,neN . (6.9) 



■?'/ roil ( ra + fc + 9m) 7n+j 



+ 1 



The numerators of (|6.7|l - l|6.9|l are polynomials of degree k+n in z, and the denominators 
are polynomials of degree fc in z. For the computation of 16.7fl and l|6.8|) . we need the 
numerical values of the partial sums f n (z), f n +i(z), . . ., f n +k{ z ), and for the computation 
of JHIlJl; we need the partial sums f„(z), f n+ i(z), . . ., f n+k +i(z). 

In the case of the v variant 14.31|l of (q m , s n , w n ), we obtain: 

uSfe (im, fn{z)) = ^ {q m , fn{z)^nln+\Z n+1 /[^n ~ ^7n+l]) 

[Ti ~\~ j ~\~ qm ) Z k j (jn+j - ZJ n +j+l)fn+j(z) 



ft; / , \ ft: — ± 

E(-^() n 

7=0 v ' m=l 



1 (n + k + q m ) j n+j j n+ j + i 



k,n e N . (6. 10) 



3 J iii ( n + fc + 9m) 7 n+J -7 n+i+ i 



The numerator of this expression is a polynomial of degree fc+n+1 in z, and the denominator 
is a polynomial of degree fc + 1 in z. For its computation, we need the numerical values of 
the partial sums f„(z), f n +{z), ■ ■ ., f„ +k +i(z). 

Next, asymptotic order estimates of the type of i|6. 3|) will be constructed for the rational 
approximants (|6.7|) - (|6.1U|) . Here, it must be taken into account that an accuracy-through- 
order relationship does not make any sense if the rational function reproduces exactly the 
function / represented by the power series. This is for instance the case if u, t, d, and v 
variants of 5 k n \q m , s n ,Lu n ) are applied to the partial sums J2™=o z " ~ 0- ~ z n+1 )/{l — z) 
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of the geometric series. For an analysis of these complications, let us consider the u variant 
()6.7)1 . If we introduce the remainders of the partial sums 1)6.1)1 according to 

oo 

r n (z) = f n (z) - /(*) = ln +v+ iZ n+v+ \ (6.11) 

then the difference between / and the u variant 1)6.7(1 can according to 1)4. 2[) be expressed 
as follows: 

f{z) - u 9 { k n \q m J n (z)) 

= - ^H. £ ^ ^ i ( " + J+g0)7 " +J . (6.12) 

ehf n ("+j+g m ) , i ^ , — 

^ W iix (« + J + g )7n+, 

The denominator of this expression is by assumption of order 0(1) as z — > 0. For the 
derivation of an order estimate of the numerator, we use ()2.14)) to obtain 

E (*) II (» +i + «n) ? T ■ B+J - 

VJ / ^ (n + J + Qohn+j z n+J 

= {-l) k 

We now have to distinguish some special cases. 

Let us first assume that the u type remainder estimate w„ = (n + qo)"/nZ n is a perfect 
remainder estimate according to 1)4.3)1 . Then, A fc acts on a polynomial of degree k — 1 in n, 
which means that the right-hand side of 1)6.12)1 is annihilated. Accordingly, u 5^ (q m , fn(z)) 
is exact for k > 1 and an accuracy-through-order relationship of the type of 1)6.3)1 makes no 
sense. 

Let us now assume that the t type remainder estimate uj n = 7„z" is a perfect remainder 
estimate according to 1)4.3)1 . which is the case if the input data {f n (z)}^L are the partial 
sums jyi=o zP ~ (1 — z n+1 )/(l — z) of the geometric series. Then, we again have to 
distinguish two cases. If qo £ {qi, ■ ■ ■ , q m }, the ratio Yl m =i( n ^~Q m ) / '(^+<Zo) simplifies to yield 
a polynomial of degree k — 2 in n which is annihilated by A fc . Accordingly, U S/ C ™' ) (<7m, fn(z)) 
is for fc > 1 exact for the partial sums of the geometric series and an accuracy-through-order 
relationship makes no sense. If qo {q%, . . . ,q m }, the ratio Y\^ n 2\{ n + <lrn) / {n + qo) does not 
simplify to yield a polynomial and is not annihilated by A fc . Accordingly, u Sfc (<Zm> fn( z )) 
is in this case not exact for the geometric series. 

The exactness for the geometric series is probably the most fundamental requirement 
for a sequence transformation in the case of linear convergence (0 < \p\ < 1 in (14. 7|) ~). 
This follows from Germain-Bonne's formal theory of convergence acceleration |64) and its 
extension to Levin-type transformations )132l Section 12]. Consequently, it is probably a 
good idea that to choose qo in in u> n = (n + <7o)As„_i according to qo £ {<Zii ■ ■ • , qm}- An 
obvious idea would be to choose qo = q\. The remainder estimates of the other u type 
transformations 1)4. 12)1 . 1)4. 13)1 . 14. 14)1 . and 1)4.15)1 all satisfy this requirement. Accordingly, 
these u variants are for k > 1 exact for the geometric series. This is also true for the t, d, 
and v variants 1)6.8)1 - 1)6.10)1 of (q m , s n ,^ n ) ■ 

By analyzing expressions of the type of 1)6. 12)1 . accuracy-through-order relationships 

for the rational approximants u 5^ (q m , fn(z)) , u Sfc (<7m, f n {z)) , „Sfc (q m , fn(z)) , and 



A 



fc-i 

IK' 

rn—l 



r n (z) 



(n + qohnZ 7, 



(6.13) 
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uSi n \<lm, fn(z)) can be derived (see for example |136l Section 5.7]). However, it is more 
elegant to do this via the theory of Pade-type approximants [22] ■ 

As is well known, the coefficients of the numerator and the denominator polynomials 
of a Pade approximants are chosen in such a way that the asymptotic order estimate 16.3(1 
is satisfied, but it is not so well known that generalizations and modifications of Pade 
approximants can be obtained by suitably modifying the asymptotic condition 1(6.3(1 . For 
example, let us consider the rational approximants 

Z/m/z = ) = --- -, l,m&N . 6.14 

yv/ m )(z) i>o + v\z + . . . + v m z m 

We assume that the two polynomials VS l ' m ^ (z) and V^/ m ^ (z) are exactly of degrees I and m 
in z, or equivalently that ui ^ and v m ^ 0. Let us now assume that the m + 1 coefficients 
wo, Vi, . . . , v m of the denominator polynomial V^/ m ^(z) are chosen according to some rule. 
Then, only the I + 1 coefficients uq, u\, . . . , ui of the numerator polynomial 1i^' m '(z) have 
to be determined via the modified asymptotic condition 

V^ l ' m \z)f{z) - U {l/m \z) = 0(z' +1 ), z->0, (6.15) 

yielding 

I 

U«/™)(z) = J2 vxz x f^x(z)- (6.16) 

A=0 

The rational function (l/m)f(z) is a so-called Pade-type approximant. Pade-type ap- 
proximants and their properties are discussed in a monograph by Brezinski |22| . 

Let us now set m = k and I = k + n with k, n, G No in 1(6.14(1 . Then, ((6.16(1 implies 

k k 
E VjZ j f k+n -j(z) ^ v k-j Z k ~ J fn+j(z) 

(*+»/*)/ w = = — k — k ■ ( 6 - 17 ) 

E v 3 z3 Y. vk ~i zk 3 

3=0 j=0 

It follows from ((6.7(1 . (|6.8[1 . and ((6.9|) that the rational approximants u S k (q m , fn(z)) , 
t9 k (q m , fn(z)) , and d9 k (q m , fn( z )) possess the following general structure: 

E Af ,n) f n+j (z) E A*? f n+k - 3 (z) 
t£°(*) = ^ = , k,neN . (6.18) 



j'=o j=0 



3 



Thus, u Sjf' (q m , f n {z)) , tSfe™" 1 (9m, /nW) , and d g^. n) (g m , /„(z)) are Pade-type approximants 
of the type of (k + n/k)f(z) with Vj — X k k J™\ 

It is a direct consequence of the defining asymptotic condition 1(6.15(1 that the Pade-type 
approximant T^\z) satisfies for all k,n £ No the accuracy-through-order relationship 

f(z) - t£°(z) = 0(z fe+n+1 ), z-0. (6.19) 

This implies that the functions (<7m> fn(z)) an d tSi™^ (<7m> fn(z)) as well as all other 
u and t type transformations considered in this article satisfy for k,n 6 No the following 
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asymptotic order estimates as z — > oo: 

f(z) - „Si n) (9m,/nW) = 0(z fc+ " +1 ), (6.20) 
f{z) - t S£ B) (*»,/»(*)) = 0(z fc +" +1 ). (6.21) 

Thus, all coefficients 70, 71, . . . , jk+n of the power series f{z) = Yl^Lo^/vZ" ', that are used 

for the construction of the rational approximants u Sjj. (Vi fn(z)) an d tS^"' ) (g m , fn( z )) > 
respectively, are reproduced by a Taylor expansion around z = 0. 

For (jSj"^(9m, fn(z)) we obtain the same asymptotic order estimate: 

f(z) - d S k n) (q m Jn(z)) = 0(z k+n+1 ), fe,neN , z->0, (6.22) 

In the context of the prediction of unknown power series coefficients, this is a highly 
unwelcome result: For the computation of d5 k (q m , fn(z)) we need the series coefficients 
70, 71, . . . , 7n+fc+i. Thus, the order term 0(z k+n+1 ) implies that a Taylor expansion of 

dSk (<lm> fn( z )) does not reproduce all coefficients used for its construction. Moreover, 
the order estimates (|6.5|l and l|6.6|) . which were derived in |149| by directly analyzing the 
corresponding expressions without using the theory of Pade-type approximants, indicate 
that we should instead get the order estimate 

f(z) - dS{ n) (q m J n (z)) = 0(z k+n + 2 ), fceN, 7^ No, z^O. (6.23) 

It is indeed possible to derive this seemingly irregular accuracy-through-order relation- 
ship by analyzing the Pade-type approximant Tj!"^ (z) more carefully. For that purpose, we 
rewrite (|6.18|l as follows: 

k 00 

A}* ' n) Tn+j+^+l Z v 

T[ n \z) = f(z) - z k+n+1 -J^ . (6.24) 

\f' n) z k -> 

3=0 

The denominator on the right-hand side is by assumption of order 0(1) as z — > 0. Ac- 
cordingly, the asymptotic estimate l|6.19[) is normally optimal, and the improved asymp- 
totic estimate ()6.23f) can only hold if the z-independent part of the numerator vanishes, or 
equivalently if X)j=o in+j+i = 0- For essentially arbitrary coefficients A^' n) this is 

certainly not true. However, in the case of all d type transformations of this article we have 

)/~/ n+ j + x, where P fc _i(n) is a suitable polynomial of degree 
k — 1 in n. Then, we have for k > 1 

Af n) 7n +j+ i = £(-!)' (*Wx(n + j) = (-l) k A k Pk-^n) = 0. (6.25) 

This proofs the refined accuracy-through-order relationship (|6.23|) . 

It follows from l|6.10|l that the rational approximant v S k (<lm, fn(z)) possesses like all 
other v type transformations of this article the following general structure: 

£ Af ' n) z k ~i fn +j (z) + z £ f^' n) z k -> f n+3 (z) 

V < k n \z) = J — ^ , fc,neN . (6.26) 

£ Xf' n) z k -i + z £ fxf ' n) z k -i 

j=0 j=0 
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Comparison with (|6.18|) shows that V^ n '(z) is no Pade-type approximant. Accordingly, 
the defining asymptotic condition (|6.15|l of Pade-type approximants cannot be applied. 
Fortunately, an analogous asymptotic order estimate for vl (z) can be derived easily. For 
that purpose, we rewrite l|6.26[) as follows: 

v[ n) (z) = /(*) 

k oc k oc 

E x (k,n) \ ~> v \ -• (k,n) \ ^ v 

,fe+n+l J=5 i=Q 



3=0 j=0 



(6.27) 



The denominator on the right-hand side is by assumption of order 0(1) as z — > 0. Accord- 
ingly, we obtain the asymptotic order estimate 

f(z) - v£\z) = 0(z k+n+1 ) , fc,neN , z^O, (6.28) 

which implies 

/(*) - v9 { k n) (q m Jn(z)) = 0(z k+n+1 ), k,neN , z^O. (6.29) 

Now, we have the same problem as in the case of the suboptimal order estimate (I6.22|) 
for d^k (imi fn(z)) '■ The order term 0(z fc+ ™ +1 ) in l|6.29|l implies that a Taylor expansion of 
vS^ (q? n , fn(z)) reproduces only 7 , 71, . . . , 7„ +fc , whereas 70, 71, . .., 7n+fc+i are needed 
for the computation of v Sk(<lm, fn(z)). Thus, we need instead the order estimate 

f(z) ~ vS k n) (q m ,fn(z)) = 0{z k+n+2 ), fceN, neN , z^O. (6.30) 

This refined asymptotic estimate can only be true if the z-independent part of the first 
numerator sum in l|6.27|l vanishes, or equivalently if 53?=o ' in+j+i = 0. For essentially 
arbitrary coefficients \^' n ^ this is certainly not true. However, in the case of the v type 
transformations of this article we have just like in the case of the d type transformations 
Af n) = {-iy§P h -i{n + j)h nW and = (-l)^ 1 §P k -i{n + j)/ ln+j) where 

Pk-i(n) is a suitable polynomial of degree k — 1 in n. Thus, l|6.25|l holds which proves the 
accuracy-through-order relationship (|6.30|) . 

In Section 0] it was mentioned that in some cases asymptotic expressions for the 
terms a n of an infinite series s = X^^Ln av are known which reproduce the leading order 
asymptotics of a n as n — » 00, and that these asymptotic expressions can also be used in the 
simple remainder estimates (|4. 1 IB . (|4. 1SB . (14.24(1 . and (|4.32|) since they also reproduce the 
leading order asymptotics of the remainders r n — s n — s as n — > 00. 

Thus, we now assume that asymptotic expressions 7i°°' ) are known that reproduce the 
leading order asymptotics of the coefficients of the power series f(z) = J2T=o ^ vZ " according 
to 

In = [c+0(l/n)] , c^O, n->co. (6.31) 

If we use in S k n \q rn ,i s n , uj n ) the u, t, v, and d type remainder estimates u> n = (n + qo)^^^ z n , 

0J n = ji^z™, u n = 7i oo) 7i+ 1 2;™ +1 /[7™ 00 '' - z l„+i]> and u> n = 7i+iZ n+1 , we obtain r ationa l 
approximants which closely resemble the u, t, v, and d variants (|6.7J) . (|6.8|l . (|6.9(l . and Hfi.lOjl . 
and which are also special cases of the rational functions T k n \z) and Vt n (z) defined in 
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(|6.18|) and l|6.26[l . respectively. Consequently, these rational approximants satisfy for all 
k, n £ Nq the following asymptotic estimates as z — > 0: 





(9 ro) /„(z),(n + « )7i oo) ^) 


= 0(z fc+ " +1 ) , 


(6.32) 


/(*; 




= 0(z fe+n+1 ), 


(6.33) 


/(*; 


' - Si n) (^./«(^).7^^") 


- 0(z fe +" +1 ), 


(6.34) 


/(*) - gl n) (<?m, /„(*), 7^ 




= 0(z fe+n+1 ). 


(6.35) 



Accordingly, all coefficients 70, 71, . . . , jk+n of the power series for f(z), which were used 
for the construction of these rational approximants. are reproduced by Taylor expansion. 

Improved asymptotic estimates of the type of (|6.23|l or l|6.30|l for the d and v type 
variants do not hold here. The reason is that the coefficients xf' n) in (|6~T%1) and l|Ofll now 
satisfy xf' n) = Q)P k -i(n + j)/^' j+v In general, we have 7n+]+i ^ In+j+i, which 

implies that 5^*_ Xj J n +j+i = docs not hold. 

If we use in 3^ (q m , s n ,uj n ) the remainder estimates uj n = [n + q^)^^^ z n , uj n — 7,^°°' z n , 
uj n = 7n^7^+ 1 z™ +1 /[7«° ' 1 — 27„+i], and uj n = 7„+|z™ +1 , the poles of the resulting rational 
approximants are determined by the parameters q m in the products [j^fn + q m ) and 
by the remainder estimates, but they do not depend on the coefficients 7„ of the power 
series for /. This highlights once more the crucial importance of the remainder estimates 
for the success or the failure of Levin-type transformations. In contrast, both the numerator 
and the denominator coefficients of a Pade approximant [l/m]f(z) depend via H6.3[) on the 
coefficients of the partial sum fi +m (z) which was used for its construction. 

7 Summary and Outlook 

Levin [HO] deserves credit for realizing that the efficiency of convergence acceleration and 
summation processes can be enhanced considerably by using as input data not only the 
elements of the sequence {s n }^L to be transformed, but also explicit estimates {uJ n }'£Lo 
for the truncation errors of this sequence. 

If the input data are the partial sums of an infinite series, and if sufficiently simple analyt- 
ical expressions for the terms of this series are known, then it is possible to derive analytical 
estimates for the truncation errors of these series. In principle, the use of specially designed 
analytical remainder estimates would be highly desirable, although the resulting expres- 
sions are no longer generally applicable sequence transformations, but rather (optimized) 
approximation schemes for specific problems (see for instance the discussion in |145| L 

However, convergence acceleration and summation methods are needed most if only rel- 
atively few elements of a slowly convergent or divergent sequence are available, and if apart 
from the numerical values of the input data virtually nothing is known. This is a scenario 
which happens only too often if we try to sum divergent perturbation expansions of quantum 
physics. In such a situation there is obviously no chance of constructing analytical expres- 
sions for remainder estimates. Instead, we must construct the remainder estimates from 
the numerical values of the input data via simple rules. Fortunately, the simple remainder 
estimates proposed by Levin [HOI and later Smith and Ford |126| . which are discussed in 
Sectional normally do the job. In spite of their simplicity, they often work remarkably well. 

If we approximate the remainder r„ of a sequence element s n by the product oj n z n 
according to 12.8fl . where z n is a so-called correction term, then we should take into account 
that our approximation scheme actually has two degrees of freedom. Levin [HOj originally 
assumed that z n is a truncated inverse power series according to (|2.16(l . This is certainly a 
very natural idea, and it leads to a very powerful sequence transformation. 
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Nevertheless, in some cases Levin's transformation fails horribly for reasons which we 
do not completely understand. For example, it was found in |148U149| that Levin's trans- 
formation diverges if it is used for the summation of the perturbation expansions for the 
ground state energies of the anharmonic oscillators (compare also [1341 Table 2] or the dis- 
cussion in [1361 Section 10.7]). A similar divergence of Levin's transformation was observed 
by Ci'zek, Zamastil, and Skala [481 p. 965] in the case of the hydrogen atom in an external 
magnetic field. Fortunately, Levin's choice for z n is not the only possibility, and at least 
for some problems, alternative correction terms produce significantly better results. For 
example, the so-called delta transformation defined in l[4.36l) is based on the assumption 
that z n is a truncated factorial series according to l[2.19[) . As mentioned before, this delta 
transformation is a very effective transformation for slowly convergent and divergent alter- 
nating series. In particular, it produces very good summation results both in the case of the 
anharmonic oscillators 133 , 134, 136 , 139 , 141 , 148 , 149 as well as in the case of the hydrogen 
atom in an external magnetic field [481 Tables I and II] . 

The sequence transformation St." (<lmi Sn,^n) introduced by Cizek, Zamastil, and Skala 
[48j permits a unified treatment of the mathematical properties of all sequence transforma- 
tions, whose correction terms are annihilated by difference operators of the type of 

f = A k P k ^(n). (7.1) 

Here, Pk-i(n) is a suitable polynomial of degree k — 1 in n that can be obtained by specializ- 
ing the parameters q m in nm=i( n + 1m)- All Levin- type transformations considered in this 
article belong to this class of sequence transformations. Consequently, all their mathematical 
properties such as explicit expressions (Sections [21 and EJ, recurrence formulas (Section [2J, 
and accuracy-through-order properties (Section EJ) can be deduced from the corresponding 
properties of Sfffa,^,^) by specializing the parameters q rn . 

In addition, new sequence transformations can be constructed by specializing the param- 
eters q m in Sl™^(<Zm) s n , uj n ). For example, Cizek, Zamastil, and Skala Tables I and II] 
found that in the case of the hydrogen atom in an external magnetic field at least for some 
coupling constants better summation results can be obtained by choosing q m — m 2 instead 
of choosing q m = m which yields the delta transformation with (3=1. Such a quadratic 
dependence of the parameters q m on m leads to a completely new sequence transforma- 
tion. Thus, the sequence transformation 9^ (<Zm, s n , ui n ) introduced by Ci'zek, Zamastil, 
and Skala j48| does not only permit a unification of already known transformations, but it 
also opens up the path for promising new research. 

As discussed in more details in the following article |146| . our current level of theo- 
retical understanding does not permit to predict which one of the numerous variants of 
St (?m) s n, ijJn) will give best results for a given convergence acceleration or summation 
problem. So, if we for example use one of the numerous Levin-type transformation for the 
summation of a divergent perturbation expansion, we are essentially conducting a numerical 
experiment. As every good experimentalist knows, a single experiment is only rarely able to 
provide a definite answer. Normally, a whole set of related experiments is needed to obtain 
convincing evidence. Of course, this applies also to our numerical experiments. Therefore, 
we should not insist with a quasi-religious zeal on using only a single (Levin-type) transfor- 
mation which we for some reason may prefer. Instead, it is usually a much better idea to 
compare the performance of several different transformations. 

Levin-type transformations are not only very powerful but also very flexible. Experience 
shows that they can handle successfully a large variety of different convergence acceleration 
or summation problems. This is a direct consequence of the fact that the ansatz u> n z n for r n 
according to l[2.8[l has two degrees of freedom which allows a considerable amount of fine- 
tuning. Nevertheless, Levin-type transformations are not a cure for all evils. Consequently, 
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a good experimentalist should also take into account the possibility that Levin-type trans- 
formations may not work at all or that other transformations could produce better results. 
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